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ABSTR ACT 

Reported are the results of a meta-analysis of 30 
studies of individualized instruction in science in which this method 
was compared with a ^traditional lecture method of science 
instruction- studies analyzed also included measurements from which 
effect sizes could be calculated. Five methods of individualized 
instruction were identified: (1) audio-tutorial instruction (AT), (2) 
computer-assisted instruction (CAD, (3) personalized system of 
instruction (PSI) , (M) programmed instruction (PI), and (5) a 
combination categorv for studies containing characteristics of 
individualization but not easily identifiable as ope of the previous 
four methods. On the basis of effect size, individTualized instruction 
appeared to be more effective than the traditional lecture approach 
for all methods studied. Findings reported were termed preliminary 
indicating this study was not completed when reported. (PB) 
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Introduction 

During the past twenty years many educational researchers have 
evaluated the effectiveness of individualized instruction in science. 
These investigations have resulted in the publication of numerous studies, 
often contradictory in their conclusions* A review and integration of 
this existing "Research brings meaning to a large collection of experiments 
whicli would otherwise be difficult to Interpret collectively. 

There are numerous narrative reviews of research on alternative 
methods of instruction. Meta-analysis, the statistical integration and 
analysis of research studies, has been employed in a few instances (Dubin & 
Taveggia, 1968; Hartley, 1978; Kullk, Kulik & Cohen, 1979). The purpose 
of this study was to determine whether individualised instruction in 
science is more effective than traditional science Instruction based 
upon a meta-analysis of findings from previous research experiments. 

The methods of individualized instruction Incorporated in this study 
were audio-tutorial instruction, computer-assisted instruction, personalized 
system of Instruction, and programmed instruction. Instruction Involving 
assorted elements of the previously listed methods were Included under a 
heading reflecting a combination approach. For the purpose of this 
study, the methods of individualized instruction were defined as follows: 
Audi o-tutorial ■fnatructlo n (AT) is an instructional method developed by 
Postlethwalt (1963) involving three main components. The Independent Study 
Session is the primary activity in audio-tutorial Instruction. Students 
ifork independentl/ in a learning ccntur equipped with laboratory materials, 
audio tapes and visual aids. The Small Asseably Session is a weekly 
meeting of six to ten students and an instructor for the pnitose. of 
discussion and quizzing. A weekly meeting, the General Assembly Session, 



It used for motlvaClonal lectures* fllma and major examinations • 
Cottputer-asalsted Instruction (CAI) involves the use of a computer in an 
interactive fashion. Programmed Instruction, drill and practice* and/or 
tutorial exercises are frequently Implemented in CAI. The Personalized 
System of Instruction (PSIj was first described by Keller (1968) and 
has frequently been termed the Keller Plan. PSI involves the following 
components: 1) printed studjy guides, 2) mastery orientation, 3) student 
proctors, 4) self -pacing, and 5) occasional lectures for motivation. 
Programmed Instruction (PI) is the presentation of Instruction in a 
step by step sequential manner. It is a procedure employed in many 
types of individualized instructional methods. For the purpose of this 
meta-analysis, programmed instruction involved information dissemination 
which was programmed and in a written format. Studies containing 
characteristics of individualization, not easily identified as one of the 
above methods, were grouped Into a Combination category. The courses 
frequently contained a study guide, objectives, pretests and posttests. 

Methodology 

This study of clternative methods of teaching science courses 
consisted of a literature search for research findings comparing one or 
more individualized methods of science instruction with traditional lecture 
instruction, a subsequent review of this literature, and the eeXection 
of studies to be analyzed. The analysis involved the comparison of 
effect sizes and their relationship to other variables reported in the 
research studies. The major goals of this meta-analytils were to reach a 
conclusion about the experimental effect of individualized instruction 
in science ani to attempt to explain the variation in the effect sizes 
obtained. ^ 



Literature Search 

Documents incorporated in this study were identified in numerous 
ways. First, a computer search of the ERIC system was utilized. A 
total of 553 documents were initially identified; approximately 100 
studies were selected for further review, of which approximately 30 
were fully analyzed and incorporated into the meta-analysis. Second, a 
computer search of Dissertation Abstracts was utilized. This search 
identified 73 dissertations, of which 23 microfilm copies were selected 
for incorporation in the study. The bibliography of each of these 
studies was reviewed to identify additional research reports. Finally, 
recent issues of selected Journals on science education were reviewed 
in search of recent research. 

Once documents were identified, the following guidelines were used 
in determining which studies were to be Included in the meta-analysis. 
First, only those studlas comparing a traditional lecture method of science 
instruction \Jlth a method of individualized Instruction were Included. 
Second, in order to be included, a study had to include measurements 
from which "affect sizes" could be calculated. The quality of the 
research ck^eign did not eliminate a study from inclusion in the meta-analysis 
Some researchers (Eysenik, 1978; Gallo, 1978; Mansfield, 1977) feel 
that only well-designed studies should be analyzed, whereas Glass (1976, 
1978) contends that ellnination of weaker studies excludes a lot of 
important and useful information. In this study all relevant research 
was included and features of the research design were identified and 
in< luded as variables in the meta-analysis. 

Within a given study, multiple outcomes were incorporated in the 
Beta-analysis. Some previous research integrators avoided the use of 
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nore than one measurement per study analyzed (Kulik, 1976; Dubin & 

Taveggla» 1968). Glass (1978) contends that much valuable information 

Is discarded by eliminating multiple measurements and suggests that 

the "finding" be the unit of analysis, rather ban the "study". In this 

meta-analysis the finding was the unit of analysis and consideration 

was given to the interdependence of various outcome measures. An 

attempt was made to exclude findings based on repeated measures of the 

same latent trait. The measurement related to the longest treatment 

time was the outcome selected for inclusion. If a number of equally viable, 

but interdependent outcome measures were indicated, a random selection 

was made. 

Data Collection and Analysis 

Each study was carefully read and intormation collected on numerous 
variables. Table 1 contains a list of variables and coding categories 
Included in this study and an indication of the number of studies and 
effect sizes Included in each category. A total of 115 studies were 

a 

analyzed and 182 effect sizes calculated. 

Effect sizes were calculated using Cohen's £ (Cohen, 1969) and 
Glass's ES (Glass. 1978). Cohen's d is the difference in the means of 
the two groups divided by the pooled standard deviation. Glass's ES is 
the difference in the means of the two groups divided by the standard 
deviation of the control group, which in this meta-analysis was the group 
taught in the traditional manner. 
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Effect size ■ ' 

s or 8 
c p 

vhere: X « mean of Individualized Instruction group 
E 

X *■ mean of traditionally taught group 

C ' 

e^ • standard deviation of traditionally taught group 
Bp * pooled standard deviation 

Studies which did not Indicate the required measurements for the 
calculation of effect sizes (I.e. X^, Xq, or s^) were Included In the 
meta-analysis and effect size measures - pproxlmated using procedures 
described by Glass (1978). When results were presented In dichotomies 
or percentages* an attempt was made to recover underlying metric Information 
by the use of the differences of the standard normal deviates (Glass* 1978). 
Effect sizes approximated in the above ways were considered to be 
calculated using pooled standard deviations. 

One hundred fifteen effect sizes were calculated using Glass's ES 
and Cohen's d.. The correlation between Glass's ES snd Cohen's d^ was 
found to be .904. This high correlation, coupled with the fact that 
more estimates of effect sizes calculated as Cohen's d[ were arailable, 
resulted in a decision to use Cohen's a.i the measure of effect size in . 
this meta-analysis. 

Results 

One of the goals of this study was to determine the effect of 
individualization in science instruction. The mean effect size, based 
on 115 studies, was .35 which falls within the rt ige of small effect sizes 
(0 to ,5) according to Coheu (1969). The effect of individualized 



Instrucdon In science* in other words, was an Increase of .35 standard 
deviations In measurable outcomes,. The mean (50th percentile) for a 
class 'taught using Individualized Instruction voul^!, therefore • be equal 
to the 64th percentile (+e35 standard deviation) of an otherwise equivalent 
class taught In a traditional lecture format. 

Effect sizes were calculated for each method of individualized 
Instruction. Table 2 shows the effect sizes for the five methods of 
ludlviduallzed Instruction Investigated. The studies classified as 
combination had the greatest effect, followed closely by computer-asslsted 
instruction and tSI. These three instructional methods had effect 
sizes approaching a medium size effect as defined by Cohen (.5 to •S). 
Audio**tutorial instruction and programmed instruction had the smallest 
effect sizes. 

A comparison was made of the effect sizes derived for each variable 
investigated in the meta*-analysis by instructional method. These 
comparisons are Included in Tables 3, 4, and 5. 

A number of variables appear to have an Impact on effect sizes for 
all instructional methods. Variables related to the degree or manner of 
individualization of instruction, as well as some variables reflecting 
research design characteristics appear correlated with effect size» 

The differences in subpopulatlon means within each of four 
Instructional and three design variables were tested at the .05 level 
using t;-tests and analysis of variance* Within two of the design 
variables, the equivalence cf subjects r^nd the uubjective rating by the 
meta-analyst ♦ significant differences were found among the means. In 
addition, significant differences were found bet^^een the subpopulation 
effect 8l?:e means within two instructional variables, mastery orientation 
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tttd the degree of selNpaclng of Instruction. No slgnlficaat differences 
were found* however « between. the subpopulatlon effect slase means for 
self -select Ion of treatment, self "-Initiated testing, and choice of 
delivery system* 

The next question addresses the Identification of the Instructional 
and design variables which account for the variance in effect size. 
Our results, while only prellmlnarv, suggest that neither set of variables 
explains very much of the variance In effect size. When effect size was 
regressed on sets of dlct^tomously coded dummy variables measuring 
variation In Instruction and design variables (see a list of these In 
Table 1), the coefficients of determination were .07 and .14, respectively, 
for the Instruc .lonal and design variables. These results are shown 
lA Tables 6 and 7. Among the design variables, those studies we rated 
as excellent exhibited effect sizes of one-half standard deviation 
larger than studies that were not coded as being excellent. Also, if 
the subjects were self -selected Into the treatment group, the effect size 
was about one-third larger than In studies where subjects were randomly 
assigned. 

In conclusion, we conducted a meta-analysis of individualized 
in&'tructlon in science tmd found, on the basis of efftJt size, that 
individualized instruction is more effective than the traditional lecture 
approach.. This Is true for all methods of individualized instruction 
studied. Although our study has not been completed, it appears that 
computer-assisted instruction (CAI) and the personalized system of 
instruction (PSI) arc more effective than audio-tutorial (AT) and 
programmed instruction (PI). 

We Identified and incorporated design and instructional variables 
within the meta-analysis. There is a significant difference in the mean 
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•ffect sizes within a few of these variables. However, our ialtlal 
attempts at explaining the variance observed in effect sixes using 
•ultiple regresaion analysis has. failed to identify any Instructional 
or design variables which account for a large portion of the variance 
in effect size« This preliminary finding suggects that differences 
observed between individualized and traditionally taught students nay 
bt a function of the presence of alternatives for the students and 
not the alternatives themselves* 
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TABLE 1 



List of Variables with Number of Studies and Effect- 
Slees for Coding Categories 



V ariable 

Source of study 
1* Journal 
2« Document 
3« Dissertation 
4 • Book 

Tear of publication 
. 1961 
1963 
196A 
1965 
1966 
1967 
1968 
1969 
1970 
1971 
1972 
1973 
197A 
1975 
1976 
1977 
1978 

Instructional setting 
1« Secondary school 
2« Coiomunlty College 

3. Four year school 
» . A. Other 

Subject of Instruction 

1, Biology 

2. Chemistry 
3» Physics 

4. Other 

Level of Instruction 
1* Introductory 
2, Advanced 



Number of 
Studies 



38 
8 

65 
4 



1 
4 
A 
3 
2 
2 
4 
8 
13 
11 
13 
12 
U 
11 
10 
5 
1 



34 
12 
67 
2 



40 
37 
20 
18 



100 
14 



Number of 
Effect Sizes 



53 
14 
110 
5 



3 
5 
4 
5 
3 
3 
9 
9 
24 
17 
18 
19 
15 
21 
14 
10 
3 



59 
20 
74 
2 



60 
58 
37 
27 



162 
19 
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TABLE 1 (continued) 



Variable 



Number of 
Studies 



Number of 
Effect Sizes 



Method of instruction 

1, Audio-tutorial (AT) 
2* Computer-assisted (CAT) 
3* Peraooalized System of 

Instruction (PS^) 
A. Programmed Instruction (PI) 
5« Combination 

Nature of instruction 

1, Replacement of existing 

instruction 
2* Supplement for existing 

instruction 

Number of weeks of instruction 



27 
11 

19 
28 
30 



101 
13 
105 



AO 
lA 

28 
A5 
56 



166 
15 
163 



Kastery orientation 

1* Non-mastery 83 

2, Mastery 28 

Self-initiated testing 

1. Self-initiated testing present 38 

2. No self-initiated testing 74 

Self-pacing of instruction 

1. Daily 19 

2. yMeeVly 44 

3. Longer period than weekly 9 
4* Entire course self-paced 41 

Choice of instructional delivery systems 

1. No choice 89 

2. Choice 26 



130 
A3 



65 

113 



33 
62 
16 
69 



138 
43 



Outcomes measure 
I4 Achievement 
2^ Attitude 

3. Retention 

4, Study time 

5« Ferfcrmance In subsequent 

courses 
6* Others 



110 
22 
19 
1 

3 
9 



114 
27 
22 
1 

5 
13 
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TABLE 1 (continued) 



Number of Number of 

Variable Studies Effect Sizes 



Subjective rating by neta-analyst 

1. Excellent 6 15 

2. Good 35 58 

3. Fair 42 65 

4. Poor 30 41 

Inatrument development 

!• Teacher developed 59 80 

2* Team developed 19 26 

3* Coomerclally available 31 48 

Hlatorlcal effect 

!• Same semeatera 97 115 

2m Different aemesters 18 26 

Continuity of Instructors 

1* Same Instructors 51 76 

2« Different Instructors 54 86 

Self-selection of treatment 

1. Yes 22 34 

2. No 87 139 

Equivalence of subjects 

1« Absent 21 30 

2« One measure 18 30 

3. 2'-4'f measures 21 32 
4* Randomization 32 53 
5* Cover la tea 20 30 

Reliability of Instrument 49 74 
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Effect 

HeLhod of Instruction 

Audio*' tutorial 

Computer assisted 

Personalized system 
of instruction 

Programmed instruction 

Combination 

Total 



TABLE 2 

Sizes of Instructional Methods 

Number of Number of 
Effect Size Studies Effect Sizes 



.21 27 40 

.42 11 14 

.42 19 28 

.27 28 45 

.47 30 56 

.35 115 182 



14 



I 



TABLE 3 Effect Sizes for Instructional Methods by Instructional Variables 



VARIABLES 


TOTAL 
Effect 

size S.D. n 


AT 

Effect 
size S.D. n 


CAI 

Effect 

size S.D. n 


PSI 

Effect 

size S.D. n 


PI 

Effect 
size S.D. n 


COM? 
Effect 

aize S.D. n 


Mastery orientation 
Nonmastery 
Mastery 


.28 .48 129 
.53 .63 43 


.21 .36 38 
.09 0 1 


.26 .73 10 
1.06 .73 2 


.22 .51 2 
.43 .46 26 


.29 .42 Al 
.52 0 1 


.36 .56 38 
»67 .91 13 


Self-pacing of Instruction 
Daily 
Longer 

Entire course 


.26 .43 28 
.33 .46 79 
.46 .69 68 


-.38 0 1 
.23 .36 37 
.08 0 1 


.46 .85 4 
.35 .33 3 
.45 1.00 5 


.77 .38 2 
.39 .46 26 


.24 .34 19 
.39 .51 18 
.36 .12 4 


.28 .08 4 
,41 .>8 19 
.55 .84 32 


Self-lnltlated testing 
Yes 
No 


.46 .68 65 
.29 .46 112 


.21 .36 39 


-.43. .01 2 
.57 .69 11 


.41 .47 27 
.50 0 1 


.48 .24 6 
.23 .44 38 


.:i6 .87 30 
.37 .50 23 


Choice of delivery system 
No chv»l''.c 
Cholcf 


.30 .47 138 
.53 .75 43 


.19 .35 38 
.74 0 1 


.39 .79 11 
.58 .30 2 


.39 .45 27 
1.03 0 1 


.25 .44 41 
.43 .23 4 


.41 .51 21 
.51 .83 35 
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TABLE 4 - Effect Sizes for Instructional Methods by Design Variables 



VARIABLES 


TOTAL 

Effect 
size S.D. n 


AT 

Effect 
size S.D. n 


CAI 

Effect 
size S.D. n 


PSI 

Effect 
size . .D. n 


PI 

Effect 
size S.D. n 


COMB 
Effect 

size S.D. n 


Subjective rating of study 
Fxc client 
Good 
Fair 
Poor 


1.08 .98 A 
.35 .55 58 
.39 .AA 6A 
.28 .50 Al 


.36 .39 17 
.10 .31 17 
.06 .20 5 


.79 0 1 
-.16 .45 3 
.44 .73 5 
.88 1.01 3 


1.10 i.57 2 
.35 .14 6 
.30 .31 13 
.50 .34 7 


.27 .27 7 
.39 .46 17 
.17 .44 19 


.82 .90 12 
.41 .74 25 
.38 .50 12 
.25 .56 7 


Instrument development 

Teacher developed 
Team developed 
Commercial 


.36 .58 80 
.A5 .52 26 
.28 .62 AS 


.23 .42 18 
.48 .35 5 
.01 .17 9 


.65 .67 7 
.36 0 1 
-.43 .01 2 


.63 .63 10 
.27 .40 7 
.15 .15 4 


.28 .41 28 
.20 .62 7 
.40 .40 3 


.38 .81 17 
.95 . .41 6 
.41 .72 30 


Self-fvelectlon of treatment 

Yes 
No 


.A9 .59 3A 
.32 .5A 139 


,20 .40 11 
.22 .35 27 


1.07 .79 3 
.07 .44 9 


.38 .23 10 
.49 .57 15 


.60 .08 4 
.23 .43 40 


.84 1.03 6 
.45 .68 48 


Equivalence of subjects 
Absent 
One measure 
2*-A+ measures 
Randomization 
Covariates 


.39 .50 30 
.08 .38 30 
.34 .46 32 
.35 .52 53 
.63 .80 30 


.00 .03 3 
.00 .03 3 
.41 .39 5 
.29 .41 17 
.06 0 1 


1.07 ,79 3 
.21 .06 2 
.63 .83 3 

-.01 .49 4 
.79 0 1 


.39 .34 10 
.25 .26 7 
.49 .34 5 
.80 .95 4 
.17 .26 2 


.52 .42 8 
.00 .52 10 
.17 .35 9 
.19 .26 11 
.60 .32 5 


.07 .50 6 

.28 .50 10 
.50 .56 17 
.70 .93 21 


Historical effect 

Same semesters 
Different semo.sters 


.35 .56 115 
.36 .56 26 


.23 .38 33 
.09 .26 6 


.46 .75 12 
-.03 0 1 


.41 .47 26 
.53 .28 2 


.24 .41 42 
.72 .39 3 


.50 .74 42 
.40 .68 14 


Continuity of instructors 
Same instructors 
Different Instructors 


.33 ,49 76 
.33 .57 86 


.15 .29 13 
.24 .41 22 


.39 .83 6 
.39 .75 6 


.43 .17 8 
.50 .58 15 


.44 .31 15 
.15 .47 25 


.32 .58 34 
.53 .75 18 



TABLE 5 - Effect Sizes for Instructional Methods by Miscellaneous Variables 



VARIABLES 


TOTAL 

Effect 
size S.Dr n 


AT 

Effect 
size S.D. n 


CAI 

Effect 
size S.D. n 


PST 

Effect 

size S.D. n 


PI 

Effect 

sice S.D. n 


COMB 

Effect 
size S.D. n 


Source of ln£onnAti.on 
Jonrnal 
Document 
Dissertation 
Book 


.38 .51 52 
.47 .82 U 
.32 .55 110 
.AO .33 5 


.38 .44 16 
.13 ,15 3 
.08 .26 20 


.41 1.13 4 
.33 .76 5 
.53 .25 4 


.47 .26 15 
.40 .33 5 


' .13 .59 10 
.24 .02 2 
.31 *38 33 


.54 .52 7 
1.02 1.24 4 
.41 .J59 45 


Setting of study 

Secondary school 
Connnunlty college 

A VT* *l f t*! if* ^ nn 


.25 .48 57 

.40 .56 20 

A1 f.f\ ion 


-.38 0 1 
.18 .35 10 

•/O .JO 


.08 .60 4 

mm * 

.57 .76 9 


.89 1.17 3 
.36 .30 25 


.24 .40 23 
.43 .25 4 
.26 .50 18 


.30 .52 29 
.60 . .57 3 
.70 .93 22 


Level of Instruction 
Introductory 
Advanced 


■ 

.32 .53 161 
.56 .71 19 


.16 .36 33 
.45 .30 6 


.47 .83 10 
.26 ,28 3 


.44 .49 24 
.30 .i6 4 


.26 .42 43 
-.18 0 1 


.40 .64 51 
1.24 1.12 5 


auDjecc or instruct ?.on 
Biology 
Chemistry 
Payslcs 
Other 


.30 .44 59 
.36 .64 58 
.41 .61 37 
.37 .54 27 


.19 .37 30 
.24 .43 3 
.27 .37 5 
.37 0 1 


.36 0 1 
.52 .88 8 
.23 .52 4 


.64 .24 3 
.63 .75 7 
.35 .26 13 
.17 .36 5 


.21 .40 11 
.25 .43 21 
-.03 .48 3 
.47 .41 10 


.54 .55 14 
.32 .73 19 
.72 .89 12 
.38 .72 11 


Nature of instruction 
Replacement 
Supplement 


.35 .55 165 
.39 .65 15 


.21 .36 39 


.05 .53 5 
.65 .78 8 


.42 .46 28 


.28 .43 37 
.09 .32 7 


.47 .72 56 

m» mm 
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TABLE 6 



Regression Results of Design Varlsbl<ts 



Variable 


B 


Beta 


Rating Excellent 


.567 


.282 


Rating - Good 


.031 


.026 


Rating • Fair 


-.032 


-.027 


Self Selection 


.302 


.213 


Equivalence is absent 


-.040 


-.027 


Equivalence on one neas. 


-.236 


-.192 


Equivalence on 2'-4+ meas. 


.037 


.025 


Randosilzatlon 


.026 


.021 


Constant 


.289 




TABLE 7 




Regression Results of 


Instructional Variables 


Variable 


h 


Beta 


Mastery 


-.228 


-.185 


Choice of Delivery 


-.209 


-.160 


Pace " Weekly 


.036 


.032 


Pace " Daily 


.005 


.003 


Self- testing 


,031 


.027 


Constant 


.645 
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